![[Article Voiceover] Reverse engineering OpenAI's o1](https://s3.castbox.fm/c7/01/d3/7fa03400effff0109644d490f3c2fecf4f_scaled_v1_400.jpg "[Article Voiceover] Reverse engineering OpenAI's o1")
[Article Voiceover] Reverse engineering OpenAI's o1
Description
What productionizing test-time compute shows us about the future of AI. Exploration has landed in language model training.
This is AI generated audio with Python and 11Labs.
Source code: https://github.com/natolambert/interconnects-tools
Original post: https://www.interconnects.ai/p/reverse-engineering-openai-o1
00:00 Reverse engineering OpenAI's o1
01:52 From Q-star to Strawberry to o1
05:13 Training o1 with reinforcement learning
09:24 What is o1 doing when given a prompt?
11:49 Questions to consider to understand o1's structure
11:56 1. How does an RL-trained language model act?
12:38 2. Is it an online / test-time search?
14:20 3. Is it one model at inference?
15:29 Open-source o1, the future of o1, and the future of AI
Fig 1: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/o1/img_014.png
Fig 2: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/o1/img_016.png
Fig 3: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/o1/img_018.png
Fig 4: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/o1/img_020.png
Fig 5: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/o1/img_024.png
Fig 6: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/o1/img_026.png
Fig 7: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/o1/img_034.png
Fig 8: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/o1/img_048.png
Get full access to Interconnects at www.interconnects.ai/subscribe
![[Article Voiceover] AI Safety's Crux: Culture vs. Capitalism](https://substackcdn.com/feed/podcast/48206/post/149851748/5dbaf463a3193f0320d3e30ae332a118.jpg "[Article Voiceover] AI Safety's Crux: Culture vs. Capitalism")
![[Article Voiceover] Llama 3.2 Vision and Molmo: Foundations for the multimodal open-source ecosystem](https://s3.castbox.fm/de/53/16/9e08bcb80bb30117167ed5823009231ff8_scaled_v1_400.jpg "[Article Voiceover] Llama 3.2 Vision and Molmo: Foundations for the multimodal open-source ecosystem")
United States
